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ABSTRACT 


Greville  and  Trench  have  studied  the  conditions  under  which  a band 

N 

matrix  has  a Toeplitz  inverse.  If  H = (h. .).  . „ has  the  property  that 

13  1,3=0 

h^  = 0 for  j - i > r or  i - j > s,  where  r >_  0,  s >_  0,  and  r + s < N, 

it  was  shown  that  H has  a Toeplitz  inverse  if  and  only  if  it  has  a special 

structure  fully  characterized  by  two  polynomials,  A(x)  of  degree  r and 

B(x)  of  degree  s.  One  consequence  of  the  special  structure  is  that  H 

itself  is  quasi-Toeplitz  in  the  sense  that  h.  , . , = h.  . so  long  as 

l+l, 3+1  13 

neither  of  these  elements  is  in  the  s by  r submatrix  in  the  upper  left 
corner  or  the  r by  s submatrix  in  the  lower  right  corner.  Suppose  H 
is  real  and  its  "Toeplitz  part"  is  given,  as  well  as  the  fact  that  it  has  a 
Toeplitz  inverse,  but  the  two  corner  submatrices  are  undetermined.  What 
are  the  possible  choices  of  the  corner  submatrices,  and  what  are  the 
corresponding  Toeplitz  inverses?  It  is  shown  in  this  paper  that  the  number 
of  possible  choices  is  finite,  and  depends  on  the  pattern  of  zeros  of  A(x) 
and  B(x).  A criterion  is  established  for  defining  a "preferred"  choice, 
which  is  unique  if  it  exists. 
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SIGNIFICANCE  AND  EXPLANATION 

In  TSR  #1879  W.  F.  Trench  and  I studied  the  conditions  for  a band 
matrix  to  have  an  inverse  that  is  a Toeplitz  matrix.  We  showed  that  if 
the  band  width  is  not  too  large,  the  band  matrix  must  itself  have  the 
Toeplitz  property  (of  equality  of  elements  along  diagonal  lines)  except  for 
two  submatrices  in  the  upper  left  and  lower  right  corners.  Sometimes  one 
knows  the  "Toeplitz  part"  of  the  band  matrix  (and  the  fact  that  it  has  a 
Toeplitz  inverse) , but  the  elements  of  the  special  corner  submatrices  are 
undetermined.  Such  a problem  arose  in  extending  moving-weighted-average 
smoothing  to  the  extremities  of  the  data  (see  MRC  TSR  #1786) . In  this 
situation  what  are  the  possible  choices  of  the  corner  submatrices,  and  what 
are  the  corresponding  inverses  of  the  entire  matrix?  This  is  the  problem 
studied  here  for  real  matrices. 

It  is  shown  that  the  number  of  possible  solutions  is  finite,  and  a way 
of  finding  them  is  described.  A "preferred  solution"  is  defined,  which  is 
unique  if  it  exists.  An  algorithm  is  given  for  determining  whether  there 
is  a preferred  solution  and  for  finding  it  if  it  exists. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 
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1.  Statement  of  the  Problem. 


In  [2]  it  was  shown  that  a band  matrix  having  a Toeplitz  inverse,  when 

the  band  width  does  not  exceed  the  order  of  the  matrix,  has  a very  special 

N 

structure.  More  specifically,  let  H = (h. .).  . . be  a real  matrix,  where 

'13  1,3=0 


(1.1) 

with 

(1-2) 

Moreover,  let 


h.  . = 0 for  3 - i > r or  i - 3 > s , 
13 


r>0,  s > 0,  r+s<N. 


IX 

H.  (x)  = y h.  .x3 
1 ID 


j=0 

be  the  generating  function  of  the  elements  of  the  ith  row  of  H.  Then  it  is 
shown  in  [2]  that  H has  a Toeplitz  inverse  if  and  only  if 


(1.3) 


H;.(x)  = 


x A(x)  I b x 
L . y 
y=0 

x1A(x)B(l/x) 

N-i 

x1B(l/x)  l a x' 
v=0  v 


(0  i < s) 

(s  £ i N - r) 

(N  - r < i < N)  , 


where 


A(x)  = l a xV  and  B(x)  = £ b xV 

v=0  V y=0  V 


are  polynomials  with  real  coefficients,  a0^0  ^ 0,  and  A(x)  and  xsB(l/x) 
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have  no  common  zero,  real  or  complex.  Equations  (1.3)  imply  that  H itself 
is  guasi-Toeplitz  in  the  sense  that  the  Toeplitz  property 


(1.4) 


hi+l, j+1 


h.  . 
13 


holds  so  long  as  neither  of  the  elements  in  (1.4)  is  in  the  s by  r sub- 
matrix in  the  upper  left  corner  of  H or  in  the  r by  s submatrix  in 
the  lower  right  corner.  In  fact,  if  we  define  the  function  h(x)  and  co- 
efficients h by 
v 


(1.5) 


r 

h(x)  = A (x) B (1/x)  = £ h xV  , 

v=-s  v 


and  if  we  take  h^  = 0 for  v > r and  v < -s , then 


(1.6) 


h.  . = h.  . 
13  3-1 


so  long  as  h is  not  in  one  of  the  two  corner  submatrices  referred  to. 

This  paper  deals  with  the  following  problem.  Suppose  H is  banded  in 
the  sense  of  (1.1)  and  (1.2)  and  is  known  to  have  a Toeplitz  inverse,  and 
suppose  further  that  the  "Toeplitz  part"  of  H is  known.  In  other  words, 
the  coefficients  h^  of  (1.5)  are  known.  But  the  elements  of  the  two 
anomalous  corner  submatrices  are  undetermined.  What  are  the  possible 
choices  of  the  elements  of  these  submatrices,  and  what  are  the  corresponding 
Toeplitz  inverses  of  H? 

This  problem  has  arisen  in  some  research  of  mine  [1]  on  extending 
smoothing  by  moving  weighted  averages  to  the  extremities  of  the  data.  Trench 
[3]  has  also  encountered  band  matrices  with  Toeplitz  inverses  in  a study  of 
prediction  of  stationary  time  series. 

It  will  be  shown  that  the  choice  of  the  elements  of  the  corner  sub- 
matrices is  in  general  not  unique,  but  the  v ber  of  possible  choices  is 
finite.  In  some  particular  cases  there  is  no  solution.  It  will  be  shown 
further  that  in  the  more  typical  case  there  is  in  a certain  sense  a single 
preferred  choice  from  among  the  finite  number  of  possible  solutions. 

2.  Existence  and  Number  of  Solutions. 

In  view  of  (1.5),  another  way  of  stating  the  problem  is  to  say  that 
h(x)  = A(x)B(l/x)  is  specified,  but  A(x)  and  B(l/x)  are  not  specified. 

3 

An  equivalent  statement  is  that  the  polynomial  x h(x)  of  degree  r + s is 


g 

to  be  expressed  as  the  product  of  two  real  polynomials  A(x)  and  x B(l/x) 

of  degrees  r and  s,  respectively.  If  A(x)  is  multiplied  by  a real 

constant  and  B(x)  is  divided  by  the  same  constant,  the  function  h(x) 

and  the  matrix  H are  not  changed,  and  the  same  solution  is  obtained.  Thus 
it  is  a question  of  apportioning  the  r + s zeros  of  xSh(x)  so  -.hat  r 

of  them  are  assigned  to  A(x)  and  the  remaining  s to  xSB(l/x).  Clearly 

(r+s  ^ 

J ways,  and  this  is  an  upper  bound  to  the  number 
of  different  solutions.  However,  in  general  there  are  some  constraints, 
as  we  shall  now  see. 

We  assume  without  loss  of  generality  that  a b ^ 0.  If  a or  b 

* r s r s 

vanishes,  we  have  chosen  the  wrong  value  of  r or  s.  If  a or  b 

o o 

3 

vanishes,  or  if  A(x)  and  x B(l/x)  have  a common  zero,  then  it  is  shown 
in  [2]  that  H is  singular,  and  so  it  does  not  have  a Toeplitz  (or  any 
other)  inverse.  Thus,  these  cases  are  automatically  ruled  out.  If  the 
zeros  of  xsh(x)  include  conjugate  complex  pairs,  they  must  be  assigned 
together,  either  to  A(x)  or  to  xsB(l/x),  as  these  are  to  be  real  poly- 
nomials. If  there  are  multiple  zeros,  they  must  be  assigned  together, 
either  to  A(x)  or  xsB(l/x);  otherwise  these  polynomials  would  have  a 
common  zero  and  H would  be  singular. 

Let  us  now  consider  some  special  cases.  If  r or  s is  zero,  the 
anomalous  corner  submatrices  are  "empty"  matrices,  and  H itself  is  a 
Toeplitz  matrix.  Thus,  if  s = 0,  H is  an  upper-triangular  Toeplitz 
matrix  {with  nonzero  diagonal  elements)  and  we  see  that  its  inverse  is  like- 
wise an  upper-Triangular  Toeplitz  matrix.  Similar  remarks  apply  to  the 
case  when  r = 0. 

If  r = s = 1,  each  of  the  corner  submatrices  consists  of  a single 
element  (the  first  and  last  diagonal  elements) . If  the  zeros  of  the 
quadratic  xh(x)  are  real  and  unequal,  there  are  two  possible  choices  of 
the  corner  elements.  If  the  zeros  are  real  and  equal,  H as  given  by  (1.3) 
is  singular.  If  they  are  complex,  there  are  no  real  values  of  the  corner 
elements  such  that  H has  a Toeplitz  inverse.  More  generally,  there  is  no 

3 

real  solution  if  all  zeros  of  x h(x)  are  complex  (so  that  r + s is 
necessarily  even),  and  r and  s are  odd. 


The  case  of  r = 2 and  s = 1 is  more  typical.  In  this  case,  there 
is  always  a solution  (except  in  the  case  of  a single  triple  zero) , since 
the  cubic  xh(x)  has  at  least  one  real  zero  and  can  be  expressed  as  the 
product  of  a real  linear  function  and  a real  quadratic.  We  may  take  the 
quadratic  factor  as  A(x)  and  the  linear  factor  as  xB(l/x).  If  the  cubic 
has  three  distinct  real  zeros,  there  are  three  possible  choices  of  the 
corner  elements. 

Of  particular  interest  is  the  "symmetrical"  case  in  which 

(2.1)  r = s and  h = h^  (v  = l,2,...,r)  . 

In  this  case  h(x)  has  the  "reciprocal"  property  that  if  A is  a zero, 

A 1 is  a zero.  It  follows  from  (2.1)  and  (1.6)  that  the  "Toeplitz  part" 

of  H is  symmetric,  and  it  seems  not  unreasonable  to  demand  that  the 

symmetry  extend  into  the  special  corner  submatrices.  In  order  to  accomplish 

this,  one  must  follow  the  rule  that  if  the  zero  A is  assigned  to  A (>:) , 

-1  s 

A must  be  assigned  to  x B(l/x) , and  vice  versa.  If  this  is  done,  A(x) 
and  B (x)  are  the  same  polynomial,  except  for  multiplication  by  a real 
constant,  and  they  can  be  normalized  so  that  A(x)  = B(x).  Under  these 
conditions,  there  is  always  a solution  if  h(x)  has  no  zeros  on  the  unit 
circle.  When  this  is  the  case,  if  2m  is  the  number  of  distinct  linear 
and  quadratic  factors  (irreducible  in  the  real  field)  of  xsh(x),  then 
the  number  of  possible  fully  symmetric  solutions  is  2m. 

If  xsh(x)  has  zeros  on  the  unit  circle,  there  is  never  a fully 
symmetric  real  solution.  If  A is  complex  and  on  the  unit  circle, 

• g 

A = A,  and  if  it  is  a simple  zero  of  x h(x) , the  aforementioned  rule 
for  assignment  of  reciprocal  zeros  cannot  be  followed  in  such  a way  that 
A(x)  and  B (x)  are  real  polynomials.  If  A is  a multiple  zero  (as  it 
must  be  if  it  is  real),  the  assignment  rule  results  in  A(x)  and  xSB(l/x) 
having  a common  zero,  and  H is  singular.  If  symmetry  of  the  special 
corner  submatrices  is  not  demanded  (even  though  the  Toeplitz  part  of  H is 
symmetric),  the  assignment  rule  need  not  be  followed,  and  there  may  be 
solutions,  even  with  zeros  of  xsh(x)  on  the  unit  circle. 

3.  The  Preferred  Solution. 

In  the  preceding  section  we  have  focused  on  the  band  matrix  H and  the 
conditions  it  must  satisfy,  as  shown  in  [2] , in  order  to  have  a Toeplitz 
inverse.  Now  let  us  look  more  closely  at  the  properties  of  the  Toeplitz 
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inverse  H ^ . It  is  clear  from  (1.3)  that  the  elements  of  the  two  special 

corner  submatrices  depend  only  on  A(x)  and  B(x)  and  do  not  depend  on  N. 

Similarly,  the  nonzero  elements  of  the  "Toeplitz  part"  of  H are  merely 

the  coefficients  h of  (1.5)  and  (1.6)  and  the  value  of  N affects  only 
v 

the  number  of  row  and  columns  containing  these  elements.  It  is  shown  in 

[2]  that  a similar  remark  applies  to  the  inverse  H 

Let  A(x)  .and  B(x)  be  fixed  polynomials  of  degrees  r and  s, 

respectively,  such  that  a b ^ 0 and  A(x)  and  xSB(l/x)  have  no  common 

o o 

factor,  and  consider  the  family  of  matrices  H given  by  (1.3)  for  all  values 

of  N not  less  than  r + s.  Consider  also  the  corresponding  family  of 

_ 1 

Toeplitz  inverses  T = (t^^)  = H 
have,  for  any  given  N, 


Since  these  are  Toeplitz  matrices,  we 


(3.1) 


t.  . = t.  . 
ij  j-i 


for  some  sequence  (t  } 

v v=-N 


(°  1 i,  j < N) 

We  shall  use  the  abbreviated  notation. 


T " T[t-N't-N+1 V 


to  denote  the  Toeplitz  matrix  of  order  N + 1 defined  by  (3.1).  It  is 
shown  in  [2]  that  the  elements  of  the  sequence  {t^}  do  not  depend  on  N. 
Under  the  stated  conditions  on  A(x)  and  B(x),  the  difference  equations 


(3.2) 


r r 

I at.  =0 
v=o  V 


-1 


\ at  = b 

v=0  V "V  ° 


i l b = 0 
l p=0  P 3+t* 


(j  > 0) 


(j  < 0)  , 


uniquely  determine  a doubly  infinite  sequence  (t  } a>,  from  which  the 

elements  of  T = H 1 are  drawn,  whatever  the  value  of  N.  Increasing  N 
merely  extends  the  sequence,  without  changing  the  values  already  determined. 

It  will  be  noted  that,  for  a given  h(x),  the  effect  on  H of  different 
choices  of  A(x)  and  B(x)  involves  only  the  special  corner  submatrices, 
but  the  effect  on  H * is  to  change  its  elements  completely. 


-5- 


r 


Now,  consider  the  series 


(3.3) 


t(x)  = I t^xV  , 

V=— oo 


which  we  may  regard  as  the  generating  function  of  the  elements  of  T = H 1 . 
For  a fixed  h(x),  this  will  be  a different  series  for  different  choices 
of  A(x)  and  B(x).  It  follows  from  (3.2)  that  each  of  these  series  is  a 
formal  "reciprocal”  of  h(x)  in  the  sense  that  formal  multiplication  by 
h(x)  gives  unity.  Is  there  some  choice  of  A(x)  and  B(x)  for  which 
(3.3)  converges  to  [h(x)]  in  some  region  of  the  complex  plane?  We  shall 
see  that  there  is  at  most  one  such  choice. 

We  shall  first  show  that  t(x)  can  be  expressed  in  the  form 


(3.4) 


t (x)  = CT(x) [B(l/X)]_1  + xsp(x) (A(x)]_1 


,-l 


where  [A(x)J  denotes  a formal  expansion  in  nonnegative  powers  of  x, 
[B(l/x)]  1 denotes  a formal  expansion  in  nonpositive  powers  of  x,  p (x) 
is  defined  by 


P (x)  = x SA(x)  y t xV  , 


v=s 


and  is  a polynomial  of  degree  less  than  r,  and  a(x)  is  given  by 


s— 1 

a(x)  = B (1/x)  l t^xV  , 

\Jrr— 00 


and  is  a polynomial  of  degree  less  than  s.  To  show  this  we  write 


(3.5) 

where 


t (x)  = t (x)  + t2(x)  , 


S-l  "» 

Vx)  = I txV'  t2(x)  = E VV  ' 

v=— oo  v 


V=S 


and  we  note  that  in  the  product  A(x)t2(x)  powers  of  x with  exponents 
r + s and  above  vanish  because  of  (3.2).  Thus,  this  product  may  be  written 
as  x p(x),  where  p(x)  is  a polynomial  of  degree  less  than  r,  and,  in 
the  sense  of  formal  multiplication, 


-6- 


(3.6) 


t2(x)  = t2 (x) A(x) (A(x) ) 


-1  = xSp(x) [A (x) ) 1 


Similarly,  all  negative  powers  of  x vanish  in  the  product  B (1/x) t (x) , 
which  is  therefore  a polynomial  a(x)  of  degree  less  than  s,  and, 
consequently , 

(3.7)  t^(x)  = t^(x)B(l/x) [B (1/x) ] 1 = o (x) [B (1/x) ) 1 . 

Substitution  of  (3.6)  and  (3.7)  in  (3.5)  gives  (3.4). 

Now,  the  series  [A(x)J  ^ converges  in  the  open  disk  with  centre  at 
the  origin  and  radius  equal  to  the  minimum  absolute  value  of  the  zeros  of 
A(x) , while  [B(l/x)J  1 converges  for  values  of  1/x  in  a disk  similarly 
related  to  B(x),  or,  in  other  words,  for  values  of  x outside  of  a 

circle  with  centre  at  the  origin  and  radius  equal  to  the  maximum  absolute 

value  of  the  zeros  of  xSB(l/x).  Thus  (3.4)  shows  that  the  series  (3.3) 
converges,  if  at  all,  in  an  open  annulus  that  is  the  intersection  of  the  two 
regions  mentioned.  This  intersection  is  nonempty  if  and  only  if  all  the 

s 

zeros  of  x B(l/x)  are  smaller  in  absolute  value  than  every  zero  of  A(x) . 

In  the  light  of  this  discussion  we  decide  to  define  the  preferred 

solution  to  the  original  problem  as  one  based  on  a choice  of  A(x)  and 
B(x)  such  that  the  series  (3.3)  converges  in  some  region  of  the  complex 
plane.  It  is  now  clear  that  there  is  at  most  one  such  solution,  and  an 
algorithm  is  immediately  suggested  for  finding  it  if  it  exists. 

s 

Let  the  zeros  of  x h(x)  be  A.A_,...,A  , arranged  in  order  of 

1 2 r+s 

nondecreasing  absolute  magnitude.  A multiple  zero  is  included  in  the 
sequence  a number  of  times  equal  to  its  multiplicity,  and,  if  there  are 
distinct  zeros  of  equal  absolute  value,  the  arrangement  of  these  among 
themselves  is  immaterial.  Then,  if  | A s [ = |A  |,  there  is  no  preferred 
solution  to  the  original  problem.  If  | Ag | < |A  |,  there  is  a preferred 
solution,  and  it  is  obtained  by  choosing  B(x)  so  that  the  zeros  of 

s 

x B (1/x)  are  A^ , A2 , . . . , Ag , and  choosing  A(x)  so  that  its  zeros  are 

A , A ,...,A  . Then  (3.3)  converges  in  the  open  annulus  with  centre 

S"T jl  s>  4 r+s 

at  the  origin  bounded  by  circles  with  radii  |Ag|  and  |As+^|. 


4.  Numerical  Examples. 

In  both  examples  r = 2,  s = 1,  and  N = 5. 
Example  1 . Let 


3 2 

Here  xh(x)  = 3x  + 19x  + 30x  + 8 = (3x  + 1)  (x  + 2)  (x  + 4) . There  are 

three  possible  choices.  We  may  take  A^ (x)  = (x  + 2) (x  + 4) , 
xB1 (1/x)  = 3x  + 1,  or  A2<x)  = ^3x  + D + 4) * xB2(1/x)  = x + 2,  or 
A3  (x)  = (3x  + 1)  (x  + 2),  xB^d/x)  = x + 4.  The  corresponding  values  of  y 
and  z are  y^  = 24,  = 18;  y2  = 4 , z2  = 13;  y3  = 2,  z3  = 7;  and  the 

corresponding  Toeplitz  inverses  are 
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is  the  preferred  inverse. 
Example  2.  Let 


Here  xh(x)  = 3x^  + 6x2  + 3x  + 6 = 3(x  + 2) (x2  + 1) 


and  the  only  possible 


choice  of  A(x)  and  xB(l/x)  (except  for  constant  multipliers)  is 
2 

A(x)  = x +1  and  xB(l/x)  = 3(x  + 2).  This  gives  y = 3 and  z = 0.  The 
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I wish  to  express  my  deep  gratitude  to  W.  F.  Trench,  who  collaborated 
in  the  earlier  work  that  underlies  the  problem  treated  here,  suggested  that 
the  number  of  possible  solutions  is  finite,  and  encouraged  me  to  pursue 
this  investigation. 
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